The study of human behavior is severely hampered by logistical problems, ethical and legal constraints, and funding shortfalls. However, the biggest difficulty of conducting social and behavioral research is the extraordinary complexity of the study phenomena. In this article, we review the impact of complexity on research design, hypothesis testing, measurement, data analyses, reproducibility, and the communication of findings in psychological science. The systematic investigation of the world often requires different approaches because of the variability in complexity. Confirmatory testing, multi-factorial (...) designs, survey methods, large samples, and modeling are frequently needed to study complex social and behavioral topics. Complexity impedes the measurement of general constructs, the reproducibility of results and scientific reporting, and the general rigor of research. Many of the benchmarks established by classic work in physical science are not attainable in studies of more complex phenomena. Consequently, the standards used to evaluate scientific research should be tethered to the complexity of the study topic. (shrink)

Judgements of the value or likelihood of a focal object or outcome have been shown to vary dramatically as a function of whether judgement is based on selective or comparative processing. This article explores the question of when selective versus comparative processing is likely, and demonstrates that as motivation and opportunity to process information carefully (operationalised as accountability and time pressure, respectively) decrease, the likelihood of selective processing increases. Moreover, we document how individuals manage to render judgements when in selective (...) processing mode by relying on categorical knowledge. (shrink)